Skip to content

[Feat]: Add dispatch & combine tuning configuration#772

Merged
coderfeli merged 16 commits into
mainfrom
yanbo/combine_perf_tuning
Jul 7, 2026
Merged

[Feat]: Add dispatch & combine tuning configuration#772
coderfeli merged 16 commits into
mainfrom
yanbo/combine_perf_tuning

Conversation

@yanboshao

@yanboshao yanboshao commented Jun 30, 2026

Copy link
Copy Markdown
Contributor

Motivation

Technical Details

  1. Added tuning configs for dispatch and combine operators
  2. Optimized combine performance when zero-copy = False
  3. Refactored dispatch and combine using high-level FlyDSL APIs

Test Plan

Test Result

Submission Checklist

@yanboshao yanboshao changed the title combine perf tuning [Feat]: Add dispatch & combine tuning configuration Jun 30, 2026
@yanboshao yanboshao marked this pull request as ready for review July 1, 2026 22:24
@yanboshao yanboshao force-pushed the yanbo/combine_perf_tuning branch 2 times, most recently from 78ad9e5 to ecca285 Compare July 6, 2026 09:17
yanboshao and others added 16 commits July 6, 2026 09:19
…fall

Co-authored-by: Cursor <cursoragent@cursor.com>
(cherry picked from commit 1d56f32)
…mized kernel

Co-authored-by: Cursor <cursoragent@cursor.com>
(cherry picked from commit 099f1c1)
Profile/cudagraph path resolved combine geometry via the op tuning table and
never forwarded --combine-block-num/--combine-warp-per-block, making config
sweeps no-ops. Pin the CLI geometry (when both are given) onto every FlyDSL
combine() call; default (unset) still falls back to the op tuning table.

(cherry picked from commit 265aed0)
…Vec/shuffle/filled, dedup fp8 pack, clean unused)
Refresh r1/pro/flash bf16 combine block_num/warp_per_block from the
full profiler+cudagraph sweep; add missing num_tokens buckets
(pro/flash 512/1024/2048, r1 8192).
@yanboshao yanboshao force-pushed the yanbo/combine_perf_tuning branch from ecca285 to 7397803 Compare July 6, 2026 09:23
@coderfeli coderfeli merged commit 6a969e0 into main Jul 7, 2026
23 of 25 checks passed
@coderfeli coderfeli deleted the yanbo/combine_perf_tuning branch July 7, 2026 02:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants